Error-driven Global Transition in a Competitive Population on a Network 
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We show, both analytically and numerically, that erroneous data transmission generates a global 
transition within a competitive population playing the Minority Game on a network. This transition, 
which resembles a phase transition, is driven by a 'temporal symmetry breaking' in the global 
outcome series. The phase boundary, which is a function of the network connectivity p and the 
error probability q, is described quantitatively by the Crowd- Anticrowd theory. 



The study of Complex Adaptive Systems is enabling 
Physics to expand its boundaries into a range of non- 
traditional areas within the biological, informational and 
socio-economic communities. Since these areas are of- 
ten rich in empirical data, they also offer Physics a new 
testing ground for theories of Complex Systems, and for 
non-equilibrium statistical mechanics in general It is 
widely recognized Q that Arthur's multi-agent El Farol 
Bar Problem (EFBP) embodies the interacting, many- 
body nature of many real- world Complex Systems. In 
particular, a binary representation of the EFBP, namely 
the Minority Game (MG) HHH0, plays the role of a 
new 'Ising Model' for theoretical physics. 

Despite widespread interest among physicists in bio- 
logical, informational and socio-economic networks @, 
researchers have only just started considering the effect 
of such networks in the MG and EFBP 2J- I* has so 
far been assumed that any information shared between 
agents is always perfectly accurate. However, real-world 
Complex Systems do not operate at such levels of per- 
fection. Furthermore, informational networks might be 
used by agents to spy and mislead rather than to benefit 
others. This raises the following question: what is the ef- 
fect of networks within a competitive population such as 
the MG, where the information transmitted is corrupted? 

Here we show analytically and numerically, that er- 
roneous data transmission generates an abrupt global 
transition within a competitive, networked population 
playing the Minority Game. This phase-like transition is 
driven by a 'temporal symmetry breaking' in the global 
outcome series. The Crowd- Anticrowd theory, which ac- 
counts for the many-body (i.e. many-agent) correlations 
inherent in the system, provides a quantitative yet phys- 
ically intuitive explanation of this phase transition. 

Our model consists of N objects or 'agents' who re- 
peatedly compete to be in a minority: for example, com- 
muters striving to choose the least crowded of two routes. 
The agents can be any form of adaptive object, e.g. bio- 
logical or mechanical, and our general setup has potential 
application to a wide range of problems in the biological, 
informational and social sciences. The minority rule can 
also be generalized 5j. At each timestep t, each agent 
decides between action +1 meaning to choose option '1', 
and action —1 meaning to choose option '0'. The win- 
ning (i.e. minority) outcome at each timestep is '0' or 
Each agent decides his actions in light of (i) global 



information which takes the form of the history of the m 
most recent global outcomes, and (ii) local information 
obtained via the cluster to which he is connected, if any. 
Such connections may be physically tangible (e.g. a tele- 
phone or Internet link, or biological structure) or physi- 
cally intangible (e.g. a wireless communication channel, 
or biochemical pathway). Adaptation is introduced by 
randomly assigning S strategies to each agent. Each of 
the 2 2 possible strategies is a bit-string of length 2 m 
defining an action (+1 or —1) for each of the 2 m possi- 
ble global outcome histories fj,(t) 0,O|. For m = 2 for 
example, there are 2 =16 possible strategies and 
2 2 = 4 possible global outcome histories: /i(t) = 00, 01, 
10 and 11. Strategies which predicted the winning (los- 
ing) action at a given timestep are assigned (deducted) 
one point. 

Agents use the connections they have, if any, to gather 
information from other agents. For simplicity we assume 
a random network between agents, fixed at the beginning 
of the game. The connection between any two agents ex- 
ists with a probability p, hence each agent is on average 
connected to p(N — 1) others. At a given timestep t, and 
with a given global history fj,(t), each agent takes the ac- 
tion predicted by the highest-scoring strategy among his 
own and those of the agents to which he is connected. 
The parameter q is the probability that an error arises 
in the information he gathers from his cluster. Alterna- 
tively, q can be viewed as the weight an agent places on 
the information gathered from his cluster. For example, 
if the action of the best strategy in his cluster is +1, the 
agent records this as a —1 with probability q (and vice 
versa for a best action —1). The information transmis- 
sion has been corrupted with probability q. Any agent 
with a higher-scoring strategy than those of his neigh- 
bors at a given timestep, is unaffected by this error - 
the only source of stochasticity which might affect him 
is the standard coin-toss used to break any ties between 
his own strategies |5|- In contrast to the agents' 'on-site' 
stochastic strategy selection arising in the Thermal Mi- 
nority Game (TMG) 0, , the stochasticity associated 
with q in our game depends on the agents' connectivity. 

We now investigate the effects of this microscopic 
connection-driven data error on the system's macroscopic 
dynamics. We shall build an analytic theory based on 
the Crowd- Anticrowd theory p| which incorporates the 
many-agent (many-body) correlations arising in the sys- 
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FIG. 1: Fluctuation in excess demand, <jd, as a function of 
the error-probability q and the network connectivity p. (a) 
Numerical results averaged over 300 runs, each with 10 5 iter- 
ations, (b) Analytic Crowd- Anticrowd theory. At high q, the 
two branches in (a) correspond to different dynamical attrac- 
tor states, while the single branch in (b) represents an effective 
average (see text). The dotted line in (b) at p = 0.25, illus- 
trates the modified analytical results for the upper branch if 
one assumes some knowledge of this branch's global output 
series. Parameters: m = I , S — 2, and N = 101. 
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FIG. 3: Contour map version of Figure 1. Contours corre- 
spond to a constant value of ao as a function of the error- 
probability q and the network connectivity p. (a) Numerical 
results, (b) Analytic Crowd-Anticrowd theory. For clarity, 
only the upper branch of the numerical results is shown for 
the high-g phase. 



RSS comprises a total of 2P = 2.2 m strategies Q. As in 
previous MG work Q , we will focus on the typical fluctu- 
ations in the excess demand D(t) away from its optimal 
value as a function of p and q. The excess demand D(t) 
at timestep t is given by: 




FIG. 2: Numerical results for individual runs, showing the 
fluctuation in excess demand, <td, around q — 0.5. Parame- 
ters as in Fig. 1. 



tern's strategy space as a result of the dynamics in the 
history space. To a very good approximation, we can 
replace the Full Strategy Space by a Reduced Strategy 
Space (RSS) which provides a minimal basis set of 
strategies for the system The appropriate choice for 
the RSS depends on the relative frequency of visits to the 
2 m histories. With all histories visited equally often, the 



K=2P 

D(t)=n_i(t)-n+i(*)= Yl a K n K{t) (1) 

K=l 



where n + \{t) (n_i(i)) is the number of agents taking 
action +1 (—1); clk = ±1 is the action predicted by 
strategy K in response to history //(£) and tik (t) is the 
number of agents using strategy K at time t. K labels the 
fT'th highest scoring strategy while K = 2P+1—K labels 
the anti-correlated strategy. In the non-networked MG 
at low m, D(t) exhibits large, crowd-driven fluctuations 
while fj,(t) follows a quasi-deterministic Eulerian Trail in 
which all histories {/x(£)} are visited equally 10]. Hence, 
the time-averages (n_i(t)) = (n+i(i)) yielding (D(i)) = 
which is the optimal value for D{t). We continue this 
focus on small m here, since we are interested in the effect 
of q on these crowd-driven fluctuations. We will assume 
that the combined effect of averaging over t for a given 
\1/ (where $ is a given realization of the initial strategy 
allocation matrix |||), and averaging over ^, will have the 
same effect as averaging over all histories. This is true 
for the non- networked MG, and produces a mean D(t) of 
zero. Hence the fluctuation (i.e. standard deviation) of 
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the excess demand, ctd, is given by: 



(2) 



strategy K as him. q therefore gives the probability that 
this agent will take the opposite action to strategy K: 
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n K = q-riK 
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(9) 



We have used the orthogonality properties of the vec- 
tors with elements an where K — 1, 2, ... , 2P Since 
riK{t) will generally fluctuate around some mean value 
n™ al1 , we have also written uk (t) — n^ can + €k{1) and 
assumed that the fluctuation terms {tK(t)} are uncorre- 
cted stochastic processes. In Eq. (2), 
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and similarly for n^? an , where: 

(1) tik is the mean number of agents whose own best 
strategy is actually the if 'th highest scoring strategy in 
the game 0: 



n K = N 



1 - 



K - 1 
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(4) 



(2) n^K is the mean number of agents who only possess 
strategies worse (i.e. lower scoring) than K , but who will 
use strategy K due to connections they have to one or 
more agents who each possess strategy K but no better: 



n^ K = (1 - qj ■ n\ K + q ■ n^- 



(5) 



where 



J>K 
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1- 1-P 



(6) 



with n q — being obtained from Eq. © by setting K — * 
K = 2P + 1 - K. 

(3) Uk—> is the mean number of agents who possess strat- 
egy K, but who will nevertheless use a strategy better 
than K due to connections: 
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and similarly for nS— 



K- 



(4) 7i^? nn accounts for the situation in which an agent is 
connected to other agents with the same highest scoring 



Figure^compares the numerical and analytical results 
for cd, which is the standard deviation in excess demand. 
The agreement is remarkable given the complexity of ud 
as a function of p and q. As the 'noise' level q increases, 
the system undergoes a change in regime at a critical 
connectivity p defined by the critical boundary C cr ;t (9, p) ■ 
Moving across C cr it(g,p), the symmetry in the global out- 
come string is spontaneously broken in a manner rem- 
iniscent of a phase transition. Specifically, the global 
outcome series changes from the \ow-q phase where it re- 
sembles the period-4 Eulerian Trail . . . 00110011 . . ., to 
a high-q phase where it comprises two distinct branches 
(see Fig. da)). Figure [21 shows individual runs near 
the critical noise threshold. The higher branch corre- 
sponds to a period-2 global outcome series . . . 1010 . . . 
which is antiferromagnetic if we denote (1) as a spa- 
tial spin up (down) as opposed to a temporal outcome. 
The lower branch corresponds to the period- 1 series of 
'frozen' outcomes . . . 0000 ... or ... 1111 . . ., i.e. ferro- 
magnetic. In this high-g phase, the system will 'choose' 
one of these two global outcome branches spontaneously, 
as a result of the type and number of links each agent 
has. This symmetry-breaking of the global outcome se- 
ries along the channel of minimum fluctuation in Fig. Q 
Ccrit (l,p), originates in the internal coupling between the 
history dynamics, the strategy space and the individual 
agent networks. Because of the initial strategy allocation 
and connections, many agents will have an in-built bias 
towards one of the two possible actions and hence act 
in a deterministic or 'decided' way at a given timestep. 
However, there exist a few 'undecided' agents who need 
to toss an unbiased coin to decide between the equally 
balanced signals they gather from their local network. It 
is the fluctuations of these few 'undecided' agents who 
then push the system onto a particular branch. 

We now discuss two technical details. First, there are 
many ties in strategy scores at very small m, and hence 
many tie-break coin-tosses. This means that the fluctua- 
tion terms {e/f (t)} can no longer be ignored. The m = 1 
surface in Fig. ^b) was therefore produced by averaging 
over the 2.2 m = 4 timesteps in the Eulerian Trail [lC|. In 
other words, the double-average in Eq. @ was evaluated 
over the 2.2 m = 4 timesteps in the Eulerian Trail. When 
a tie-break between the strategies K = 1 and K = 2 
arises at one of the four timesteps, one replaces n^^j 1 and 
«x=2 b y U n K=x + n K=2) at that timestep. Likewise, 
for tie-breaks between any other K and K' . In this way, 
the average over the Eulerian Trail is easily evaluated 
analytically. As m increases, there are more timesteps 
over which one must average (i.e. 2P = 2.2 m timesteps). 
However, since ties also become less frequent as m in- 
creases, one can simply ignore them without significant 
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loss of accuracy (seeRef. Q in which good agreement is 
obtained for the non-networked MG for a wide range of m 
values without considering ties). Second, the theory has 
assumed the non-networked MG result that the dynam- 
ics follow the Eulerian Trail. Only one branch therefore 
emerges in Fig. IHb) at high q, appearing like some effec- 
tive average over the global output series for all branches 
in Fig. [Tfa). If instead one uses knowledge of the actual 
global output series for these separate branches (i.e. anti- 
ferromagnetic or ferromagnetic), then results even closer 
to Fig. nja) can be obtained. This is illustrated at one 
particular p by the dotted line in Fig. ^b) . 

Figure|3|provides a contour plot of <td around the min- 
imum. The black contour, centered around the critical 
curve C c rit(q,p), effectively separates the two different 
regimes of behavior. The low crjj values around C CT it(q,p) 
can be easily understood using the physical picture pro- 
vided by the Crowd- Anticrowd theory: the stochasticity 
induced by q (i.e. noise) breaks up the size of the Crowds 
using a given strategy K, while simultaneously increas- 
ing the size of the Anticrowds using the opposite strategy 
K. It is remarkable that a linear increase in the 'noise' 
q gives rise to such a non-linear variation in <7rj. Us- 
ing the analytic expressions in this paper, an equation 
for C cr jt(g,p) can be obtained - however we do not in- 



clude it because it is cumbersome. As noted above, the 
theory neglects a full treatment of the dynamical fluc- 
tuations around n^ can . Hence, the theory overestimates 
the Crowd- Anticrowd cancellation arising in Eq. (J2J and 
thus slightly underestimates <td in the neighborhood of 
C C Tit(q,p) (compare Figs. a) andl^b)). As p increases, 
C CT it(q,p) becomes less dependent on the connectivity p 
since more and more agents join the same network clus- 
ter. For p > 0.05 the system passes the percolation 
threshold and hence is dominated by a giant, common 
cluster. 

Finally, we note that if instead of introducing er- 
rors into the local transmission of information, as in the 
present work, one induces noise at the global level via 
errors in the global outcome series, the results for the 
excess demand are reasonably similar to those presented 
here. Our results raise the interesting possibility whereby 
imperfect information transmission could be induced at 
the local and/or global level in order to achieve a desired 
change in the macroscopic fluctuations within biological, 
informational or socio-economic systems. 
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